method to differentiate between the background and foreground of a scenario in images recorded by an

专利摘要:
METHOD FOR DIFFERENTIATING BETWEEN THE BACKGROUND AND THE FIRST PLAN OF A SCENARIO IN IMAGES RECORDED BY AN ELECTRONIC CAMERA, METHOD FOR REPLACING A BACKGROUND FROM A SCENARIO IMAGE AND ELECTRONIC VIEWING SYSTEMThe present invention relates to a method for differentiating between the background and the foreground in images or films of a scenario recorded by an electronic camera. The invention further relates to a method for replacing the background in recorded footage of a scene while maintaining the foreground.
公开号:BR112013006763A2
申请号:R112013006763-2
申请日:2011-08-16
公开日:2020-10-06
发明作者:Wolfgang Vonolfen；Rainer Wollsiefen
申请人:Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.；
IPC主号:

专利说明:

METHOD FOR DIFFERENTIATING BETWEEN FUND AND FIRST PLAN OF A SCENARIO IN IMAGES RECORDED BY AN ELECTRONIC CAMERA, METHOD TO REPLACE A BACKGROUND OF A PICTURE OF
A SCENARIO AND ELECTRONIC VISUALIZATION SYSTEM 5 The present invention relates to a method for differentiating between the background and the foreground in images or films of a scenario recorded by an electronic camera. The invention further relates to a method for replacing the background in recorded images of films of a scene while.
- 10 keeps the foreground. In order to separate objects or people recorded by a camera, which are opposite each other in a real scene and consequently hide from each other, there are several methods according to the state of the art. The most widely used method is, therefore, the chroma coding that has been used for a long time and in which the background in the current scene has a definite color that does not occur in the foreground objects. Through a simple color analysis of the engraved image, this background can then be detected and separated from the first panel. A disadvantage of this method is the fact that the background in the current scene must be present in a defined color, which is not always possible to obtain in many situations. It is the object of the present invention to indicate a method 25 to differentiate between the background and the foreground in irrtations or films of a scenario recorded by an electronic camera, which allows freedom in the design of the background and the foreground. In addition, it is an object to indicate a method for replacing a background in an image or a scenery film in which the background 30 and the foreground can be freely designed. This object is achieved through the method of differentiating between background and foreground in images of a scenario recorded by an electronic camera according to the current claim 2/27, the method for replacing a background in an image of a scenario according to claims 28 and The electronic display system according to claim 29. The independent claims indicate 5 advantageous developments of the methods according to
Q invention. According to the invention, a method is provided, whereby the background and foreground can be differentiated from one another in-images __ from a scene recorded by an electronic camera. The part of the scene that is away from the camera is thus considered as the background and the part of the scene near the camera is the foreground. The scenario consists of all the objects present in the background and in the foreground. If references are made to images in this context, they may be still images or preferably frames from a film. Neither the background nor the foreground should completely fill the image and can only appear in parts and not in the entire image. The method according to the invention can also be used in 20 partial image zones. Thus, for example, in recordings of sporting events, advertising on the perimeter of the field can be differentiated from the players who are in front of .b, itself. In general it is assumed that the first pIan covers the bottom in areas seen from the camera's perspective.
The method according to the invention can be implemented in still images and in scenery films that are recorded with an electronic camera, that is, for example, a camera with a CCD or CMOS image sensor. In principle, the method can also be implemented based on the 30 image signals recorded by analog electrical cameras, with implementation with digital cameras being preferable.
According to the invention, the background can display any image. This can be, for example, an image with
3/27 + - · - 4 a plurality of colors and / or a plurality of brightness phases, in particular, a uniformly bright monochromatic surface is preferably not understood as an image in the sense of this document.
5 The background image is now displayed as an encoding that preserves the visibility of the image for a human observer straight from the scene or even completely invisible to a scene observer. the image with the encoding visible to a right viewer of the scene means that this visibility is at least provided if the viewer is directly observing the scene in situ and is sufficiently distant from the background, the distance at which he can still recognize the content of image. The encoding of the image can assert understanding the structure of the image or the background as long as it has a quality such that an observer recognizes the image at a sufficient distance without the respective structuring thus having a disturbing or noticeable effect.
An image or film of the scenery with the background and the encoding and also with a foreground located in front of the background is now recorded through an electronic camera. A camera image sensor that records the images of the scene thus produces a signal. In this signal, the background is now distinguished from the foreground by coding. It is so exploited that the background has the encoding of the foreground not. Since the differentiation between the background and the foreground is assumed in the signal of that image sensor that records the images or the scenery film for later viewing or processing or transmission, the method can be implemented with a camera that has only one image sensor, namely the one that records images without the need for a plurality of image sensors.
. . · 4. ·. . .
Preferably, the method is thus implemented with precisely an image sensor. According to the invention, therefore, only an image signal is required in this image sensor.
5 In some ways of execution, it may be necessary, to recognize the background through encoding, to properly modify the image to be recorded by the camera or image sensor. It is therefore preferable if the recorded image of the scenario is modified for storage, further processing or transmission in such a way that the modification is made immediately before the image is recorded so that at least the foreground in the image that ends up being produced remains unchanged as it would appear in an unmodified image.
In an advantageous embodiment of the invention, the encoding of the image or the background may comprise the background periodically displaying alternate different components of the image, the components of a period comprising the entire image respectively. The length of the period, that is, the time within which all components of the image are displayed at once, is thus selected to be so short that the complete image is visible to a direct viewer b r of the scene. A time of exposure of the camera is now synchronized with the visualization of the components in such a way that the camera always records only one component of the image that is chosen in such a way that allows the differentiation between the foreground and the background through a method of modulation, preferably through color modulation, such as, for example, chroma modulation. If m is the number of 30 components into which the image is subdivided, then if the camera records precisely one component of each period, so as to be advantageous, the frequency at which the components change when displayed m - times the frequency of exposure gives
5/27 During the display of these components, at least one image parameter that influences the image display can be changed over a period of time. An image parameter, for example, can be understood as a value or a group of values of weighting or scaling factors that are suitable for controlling the color channels, contrast, brightness and / or saturation of individual pixels , groups of pixels (patterns) or the entire image.
For modulation, the component with the background recorded during the exposure of the camera offers a mask that allows the differentiation of the background from the foreground. Thus, for example, the exposed component may exhibit a specific color component of the amplified background image or exclusively, this color component being chosen preferably so as not to be present, or only weakly, in the foreground. In this case, the foreground can be differentiated from the background, for example, through a color modulation, in particular a chroma modulation.
According to the invention, any method that allows the production of a mask, through which the background and the foreground can be differentiated, must be understood as a modulation process in all forms of implementation of the invention. In general, "modulation" describes a process for detecting components in an image or video. The components can thus be recognized or filtered (image analysis) and possibly replaced by other image sources (image composition). In image analysis, specific characteristics or encodings in the image are detected and a mask that corresponds to the components of the image to be detected is generated from there. the mask can serve as a model in the composition of the image. The calculation of the mask based on property or coding does not necessarily need to be complete and can be supplemented by later processes. Included here are, for example, image analysis processes, such as optical flow, image segmentation according to color, edges or similar or heuristics (ie assumptions about objects in the scene). In particular, the information can be derived from a camera in detection mode, with the help of which the viewing angle of the camera in the scene is known so that 0 the location and size of the background, or even the first · 10 plane, in the image can be predetermined. In general, there is thus, added to the background as encoding, a property that does not occur in the foreground, or that occurs in a weaker way, such that the background can be differentiated from the foreground in a mask 15 based on this property. In the form of execution described above, the component used for the exhibition provides the mask used for the modulation. The other component or components of a period complete the image to form the complete image for a direct observer of the scenario. When viewing these other components, the camera preferably does not record.
For example, the component displayed during. Exposure can exhibit a specific color component of the image, amplified or reduced in size that the first "25 plane can be distinguished from the background through this color component. The exposed component thus displays this increased color component when the foreground shows it. reduced or reduced when the foreground shows it enlarged The component or the other components that the background 30 shows in a period can then display the complementary color components correspondingly reduced or enlarged so that the direct viewer of the scene perceives the current colors of the Image.
"7/27 In an advantageous embodiment of the invention, the background image can be divided into the components that are alternately displayed at a specific frequency, respectively. The camera can then record synchronously at half the exchange frequency. For this reason, two components of the image are always displayed during a camera cycle.The frequency with which the displayed component changes is thus twice as high as the exposure frequency of the camera.
· 10 In another embodiment, given as an example, of the embodiment described above, colors can be divided into three components and only one third exposed. The chamber thus exposes only one of the three components. In this case, the frequency with which the component changes would be selected to be three times higher than the exposure frequency of the camera. Another way of carrying out the method, according to the invention, ensures that the encoding of the image or the background comprises the background temporarily displaying alternating patterns, which complement each other, within a period to form the complete image. The background can be distinguished from the foreground in the image sensor signal. through an alternating pattern periodically. In an advantageous embodiment of the invention, the detection of a pattern, for example, based on a Fourier transform and / or Foürier filtering, can thus be implemented in the image sensor signal. Consequently, the background can be differentiated from the foreground through the frequency with which the patterns are displayed to alternate. In a Fourier transform, the bottom zones show a component of the alternating frequency that the foreground does not show. The patterns that the background shows can advantageously
"8/27" "" "". -.
be periodic in the direction of digitization of the image sensor and can, in particular, be, for example, of the chessboard pattern. The individual zones of the pattern, that is, for example, the chessboard squares, can oscillate between light and dark as well as between various color components. In order to produce the oscillating pattern, the bottom. it can be self-illuminating, inter alia, for example an LED display, or a controllable filter, corresponding to the. pattern can "10 also be arranged in front of the background image, a filter that periodically blocks different parts of the image alternately. In the case of a chessboard pattern, the oscillating pattern may appear alternately in the 15 chess pattern and the inverted. Preferably, the pattern is binary, that is, it alternates precisely between two states. A certain zone of the pattern, in one state, lets the light pass through completely or illuminates, with the maximum brightness, and in another state , dims the light in the image or illuminates with reduced brightness. Fading can be total or total darkness. In an implementation form of the invention, the image and background coding can comprise the image being represented in a grid in the form of colorful dots on a "2S backdrop. The colored dots together with the background around them thus make up the color of the image at the location of the colored dot. It is thus also possible that the background of the image is black, so that the color of the image is given precisely by the color of the colored dots.
30 A color filter is now placed in front of the image sensor or in front of the camera, a color filter that blurs precisely the colors of the colored dots or filters them and possibly lets the background colors pass without
"" '9 "/ 27" "" "" "
blur them.
Since in practice, the background is not completely black, the color filter, even in the case of a black background, lets these colors pass which are not the colors of the colored dots without blurring them. 5 In the image recorded by the image sensor, the background color of the image is increased in relation to the colors of the colored dots as a result of the filter.
If now,
# As with all color-based embodiments of the invention, a color is selected for the background that does not
"10 is present in the first stage or only in a weak way, so it is possible to differentiate the background from the first plane through a color modulation.
It is also possible to select the color filter in such a way that all the colors of the scene, with the exception of the colored dots, can be
15 composed of colors allowed to pass through the color filter.
In order to display the foreground in the image finally produced without color deviation, the effect of the color filter in front of the image sensor can be calculated.
In an especially preferred form of execution, the
The color filter in front of the image sensor can be a spectral filter, particularly an interference filter,
that filters specific ranges of the visible spectrum that are
+ spread over the entire visible range.
In front of each of the colored dots respectively, you can then arrange a
"25 spectral filter or interference filter that is
- complementary to the filter in front of the camera, a filter that in turn lets colors pass evenly distributed across the visible spectrum in such a way that from these all the colors that are necessary to display the image, can be
30 exhibits.
The fact that the color filters of the colored dots and the camera are complementary, here means that, within the visible range, they pass through different ranges essentially not overlapping the visible spectrum.
Instead of interference filters, for example, filters can also be used
Notch.
Due to the colored dots, the background represents the image in a grid.
The grid resolution is thus chosen
5 preferably so that an observer of the scenery recognizes the image from a specific distance The colored dots of the background can be configured
. to be reflective or self-illuminating.
AutQ.-iIuminated colored dots can be produced, for example, through
'10 lamps or light diodes (LEDs). Since the light diodes can be made with very monochromatic light, it is possible to compose the colored dots of the background from light diodes and, through a filter in front of the image sensor or camera, for example, a light filter. interference, filter
15 or precisely blur the frequencies transmitted by the light diodes.
If the frequencies not transmitted by the light diodes are allowed to pass through the filter in front of the camera without being blurred, the background of the image and also the foreground can be displayed from these
20 colors.
In another embodiment of the invention, the image encoding can comprise the radiating background or
· Reflect only colors selected from at least one, preferably at least two ranges of the visible '25 spectrum, spaced in relation to one another in the spectrum.
A color filter through which the light that emanates from the scene passes before it hits the image sensor is now arranged in the image sensor or camera head.
The referred color filter is selected in order to blur the spectrum ranges
30 visible from which the colors of the image are selected, but let ranges of the visible spectrum between these ranges pass without blurring them.
In this way, the background is present in the dim or dark start sensor,
11/27 "while the foreground appears composed of three colors that have been passed through the color filter. If the filtered ranges or ranges of the spectrum that have been passed through are properly selected, all the colors of the foreground can therefore be displayed In particular, the choice of shanks that are allowed to pass can also be adapted to the colors that occur in the foreground .In the image recorded by the sensor, the first plane is now differentiated from the background through modulation in relation to the faded areas. in this case, the fading mask produces the modulation mask. If the fading by the filter in front of the image sensor is not complete, then, as necessary, the fading areas, in particular the foreground, can be reconstructed in a way that display the final image. Advantageously, the background coding can be obtained in this case, having a corresponding color filter, that is, for example, a filter interference path, in front of the background or behind the first stage, that is, between the background and the foreground. In this way, the light emanating from the background passes through this color filter so that, from the background, essentially only that light that is filtered through the filter between the background and the foreground falls on the color filter in front of the camera.
Color components that are neither filtered nor smoothed by the filter in front of the camera thus emerge only from the foreground.
In another possible embodiment of the invention, the background coding may comprise the background emitting electromagnetic radiation in at least one non-visible spectral range. A conversion device can now be arranged in front of the image sensor or in front of the camera. This can have a planar configuration, having a
12/27 "" "" "" surface oriented essentially parallel to the image sensor and / or parallel to the light input surface of the camera. The conversion device now has zones in which the visible light can pass through the device without impedance. In other areas, the device has elements that cause a conversion of non-visible radiation into visible light d and include the light converted in the path of the beam of light emanating from the bottom. inclusion in the beam path can occur, "10 for example, through one or more suitable lenses that include the light-converting element in the beam path of the camera lens system such that it appears before the camera as part of the background Advantageously, a separate lens of this type is assigned to each light conversion element 15. Preferably, the conversion elements are arranged on the surface of the conversion device in a grid. They are also present on this surface in equidistant spaces. visible is able to pass through the device 20 between the conversion elements.The non-visible electromagnetic radiation can be UV radiation or infrared radiation.
In the image recorded by the image sensor, the conversion device produces a mask, through which "25 the background differs, through a modulation process, from the foreground that does not emit, or only does it to a lesser extent, the corresponding non-visible radiation Advantageously, the conversion device converts the non-visible light into a color that does not occur in the foreground or only to a lesser extent.
30 Coino light conversion elements possible use dots of fluorescent or phosphorescent material. in turn, a device for dot integration is available, preferably
13/27 "" "" "" corresponding at the bottom of the camera beam path, for each of the dots. The conversion of light by fluorescent or Eosforescent materials here produces undirected visible light of a specific color. For this reason, 5 lenses that are subsequently positioned and integrated into the filter are preferably used from Eorma to group this diffused light that corresponds to the otic path. As assistance, you can also use barriers here in the filter that complement the corresponding function of the lens.
The barriers can thus absorb or reflect part of the diffuse light, which cannot be grouped in the path of the camera beam, as a result of its direction through the lens because it extends, for example, transversely, in relation to the path of the beam. As for the diffuse light contrary to the beam path, the barrier can be semi-reflective (that is, the incident non-visible electromagnetic radiation is allowed to pass, the diffuse light converted by the materials is, in contrast, reflected in the reverse direction and again redirected to the beam path).
In another embodiment of the present invention, the image encoding may comprise the background or the image radiating and / or reflecting polarized light only in a specific polarization direction or rotation polarization direction. Here, linear polarization or circular polarization can be used. A color filter and a polarization filter are now arranged in front of the camera or image sensor, which filter, through which the light emanating from the scene passes before it hits the image sensor. preferably, the color filter is thus arranged in front of the polarization filter in such a way that the light emanating from the scene flows first through the color filter and then through the polarization filter before it strikes the image sensor. The color filter preferably achieves
fade or enlarge or amplify a color component.
The polarization filter in front of the image sensor is thus oriented in such a way that it filters the light from the polarization that is radiated or reflected by the image. As a result, differentiation of the foreground background can be accomplished through modulation in the dark image components in the image produced by the image sensor. The dark components of the image that have no color tone of the color fi-Lt-ro serve as a mask for modulation. Reference may be made to the fact that the color filter here, preferably, only blurs the corresponding color component but does not filter it completely. In this way, these black zones, which are produced as a result of the fact that the polarization filter filters the polarized light from the bottom, can be differentiated from the eventual black zones in the foreground as a result of the latter having a lighter black that has the color tone of the color filter.
The black engraved in the natural scenes is not completely dark but rather dark gray. The objects also obtain a color tone that is not perceptible but measurable due to the color filter. The light reduced by the polarization filter is however absorbed very extensively, independently In another possible embodiment of the present invention, the encoding of the image or the background comprises the background emitting electromagnetic radiation in at least one non-visible spectral range, such as UV or infrared. which the light emanating from the scene passes through, before falling on the image sensor, is now arranged in front of the image sensor. This conversion device converts the non-visible electromagnetic radiation that flows from the scene into visible light and mixes it on the scene from the perspective of the image sensor. Advantageously, the conversion device has a beam separator through which the light comes out before it hits the s image sensor that deflects non-visible radiation at least partially, in the direction of a converter that detects non-visible radiation and produces a corresponding pattern of visible light that corresponds precisely to the background. This visible light can be mixed in the path of the beam towards the image sensor, for example, through a semi-permeable mirror such that the image sensor sees the scene through the semi-permeable mirror and the beam separator. Therefore, in this form of execution, the non-visible radiation is first deflected, through the beam separator at least in part, out of the beam path and an image that corresponds to the background is mixed through the semi-permeable mirror. The converter can have an image sensor and an image lens system through which an image of the background is produced in the image sensor from non-visible radiation. The conversion device is able to produce the corresponding visible radiation, for example, through a visualization of the image, which is mixed in the path of the camera beam, as described. The mixed image in the viewfinder forms an additional color tone or pattern in the background area in the image produced by the camera's image sensor. Subsequent modulation produces a mask, through which the bottom can be differentiated from the first stage.
In all forms of execution, an element to be arranged in front of the camera or in front of the image sensor means that it is placed between the image sensor and the foreground of the scene. It can thus be accommodated in front of the camera lens system, in the camera lens system or between the camera lens system and the image sensor. The fact that a filter can be placed in front of the bottom means that it is placed, on the one hand between the image or the background and on the other hand the first pIan. In all embodiments of the invention where periodic alternating background components or a background image appear, the alternating frequency is preferably higher than the maximum noticeable alternating frequency of 25 Hz, above which the displayed alternating components are noticeable by observer as an image - shared by the components.- The frequency alternates. it is preferably 50 Hz or more. The invention is intended to be explained subsequently, by way of example, using some figures. The same reference numbers therefore correspond to the same or corresponding characteristics. The features illustrated in the examples can thus be combined into several examples and produced independently of the specific example.
They illustrate: Figure 1, a construction to implement the method according to the invention according to a first embodiment of the present invention; Figure 2, a construction for implementing the method according to the invention according to a second way of carrying out the present invention; Figure 3, a construction for implementing the method according to the invention according to a third embodiment of the present invention; Figure 4, a construction for implementing the method according to the invention according to a fourth embodiment of the present invention; Figure 5, a construction for implementing the method according to the invention according to a fifth embodiment of the present invention;
17/2 "7 to Figure 6, a construction to implement the method according to the invention according to a sixth embodiment of the present invention; Figure 7, a construction to implement the method according to the invention according to with a seventh embodiment of the present invention, Figure 8, two spectra of two mutually complementary 0 interference filters in schematic representation.
"10 Figure 1 shows a device for implementing the method, according to the invention, according to a first embodiment of the invention. A scenario with a foreground 2 and a background 3 is filmed with a camera 1. The camera 1 has an image sensor, not shown, which produces an image signal 15 which is supplied to a device for image analysis and / or image processing 5. The camera 1 may have, for example, a lens system of image la and a camera housing lb in which the image sensor is arranged The first plane 2 is a simple cube in the illustrated example 20. In all embodiments, the method according to the invention, however, can be implemented with any first plans 2, in particular, for example sportspeople 4 of a sporting event. The bottom 3 can also be of any type as long as it allows coding such as "25 necessary to implement the invention. For example, the fund can be a studio Eundo or an advertisement on the perimeter of the field in a stadium. In the example shown in Figure 1, bottom 3 shows an image. Different components, respectively of a period of the image, to be periodically grounded, are thus represented, in which the components make up the complete image. The visualization of the image components in times ti, t2, t3 ..., ta, ... is now synchronized with the exposure of the camera in such a way that the camera records, in at least one period, preferably in each period, only specifically one of the components ti, t3, ts, ... which is selected in order to allow the differentiation between the foreground and the background, in the irnagem signal, through modulation. coding can be, for example, color modulation, preferably chroma modulation. The analysis device 5 thus differentiates the foreground background into * 4__ images recorded by the camera 1 image sensor.
° 10 In the illustrated example, the background image can be divided, for example, into two images, the first image comprising a color component optionally blurred in relation to the original background image and the second image the complementary colors so that the image original is produced in the combination of both images. Both images can be displayed by alternating a high frequency that are no longer individually perceived by an observer (eg, 100 Hz). The recording chamber 1 can then operate synchronously at half the frequency (for example 20, 50 Hz) and with a reduced exposure time (for example, 1/100 sec.) So that only the first of two images with the component chosen color is recorded by her.
· The method can also be produced here passively with a reflective background. for this purpose, an actuable LCD color filter "25 can be placed in front of the background, which allows the corresponding component of the image to pass through respectively. In the active case in which the background is self-illuminating (for example, with the LCD display ), the Eundo can be specifically acted to show correspondingly the 30 components of the image. Figure 2 shows another advantageous arrangement of the invention to implement the method according to the invention. The background for the coding periodically shows patterns here
. -, -, .., alternates that complement each other within a period to form the complete image. If all the patterns of a period are seen together, the complete image is produced.
5 The scenario comprising the bottom 3 and the foreground 2 is recorded by the camera's image sensor 1 and c) image signal 4 is analyzed using an analysis device
5. In the image recorded by the image sensor, background 3 can now be differentiated. of the foreground 2 through a. . pattern that alternates periodically. For this purpose, a Fourier transform can be implemented, for example in signal 4 of the image sensor, and the background 3 can be differentiated from the first plane 2 through the frequency of the alternate visualization of the patterns. The image sensor can thus be digitized, for example, errt lines and the analysis can be implemented directly on the digitizing signal.
The alternating pattern periodically produces a frequency component in the Fourier transform with the frequency alternating whenever the background is displayed.
The analysis can be carried out over the long term through an analysis of successive languages and within an image. Thus, the corresponding pattern can be searched for in the image analysis of camera 1. The analysis can be assisted by information from a camera in detection mode. For example, information from the camera in detection mode can help determine the size of the pattern.
Different patterns are possible. In the illustrated case, bottom 3 shows a chessboard-like pattern with alternating black squares and squares that show the cutout of the image at the corresponding square location. The chessboard-like pattern and the complementary chessboard-like pattern, in which case the black squares and the squares showing the image are switched from the current chess pattern, appear here alternately. The frequency of the oscillation is selected to be so high that it cannot be perceived by the observer 5 (for example, 50 Hz). The frequency can also be coupled with the camera's image frequency.
The bottom pattern can be produced passively, for example, by an actuator filter, such as a filter. ..LCD .. It can also be actively configured as a background. with self-illumination, for example, an LED display. Figure 3 shows another possible arrangement- of the invention to implement the method according to the invention.
For coding, the image here is represented by colored dots 6 on a backdrop 7. The colored dots 6 on backdrop 7 are preferably arranged in the form of a grid. The colored dots 6 together with the background around the rhinestones, represent the color of the image in the corresponding location. The background can also be black in order to provide a total contribution to the color of the image by the colored dots. A color filter 8 is now arranged in front of the image sensor of camera 1, preferably in front of lens 1a of camera 1, a color filter that blurs or precisely filters the colors radiated by the colored dots. preferably, the color of the background 7 of the background 3 is selected in such a way that it does not occur, or only occurs in a small amount, in the first plane 2. In the image signal 4 produced by the camera sensor 1, the foreground 2 can then be differentiated from the background 3, in the analysis device 5, through modulation for the color tone of the background 7. The background 7 thus forms the color to be analyzed (or pattern) for the production of a mask for modulation. preferably the dots are arranged so that
"21/27 that the grid does not appear to be in the form of a grid for a direct observer at a specific minimum distance. This minimum distance can be provided, for example, by the normal location of observers in the scenario itself, in the case of advertising on the perimeter. of the field in a stadium, for example, by the distance from the banks closest to advertising on the perimeter of the field, if colored dots # 6 are then arranged in a grid with a specially colored or black backdrop 7 in reduced spacing · 10 relatively each other, the current image is visible to the observer, and the grid must also be chosen to be so narrow that the grid cannot be detected by the camera from its position at a specific minimum distance. As for a scenario observer, the desired color impression is then produced from the corresponding distance from the background. specific wavelengths of the visible light beam which 20 are filtered precisely by the color filter 8 in front of the image sensor so that only the background color remains essentially on the image sensor.
m The solution with these interference filters, which are shown in Figure 3 and are treated in more detail "25 with reference to Figure 8, can be obtained in a particularly favorable way. An interference filter that allows only a part of the frequencies of the visible spectrum is here arranged in front of each colored dot 6. Thus, the part preferably has a plurality of zones 30 spaced from each other distributed over a visible spectrum so that the colors of the image can be composed therefrom. color filter 8 is then an interference filter that is complementary to the color filters in front of the colored dots 6, an interference filter that precisely filters or blurs the colors that are allowed to pass through the color filters in front of the colored dots 6 without The colored dots 6 are preferably self-illuminated, that is, for example, lamps or LEDs.
Figure 4 shows another form of execution. possible to implement the method according to the invention. Here, between a background 3 and the foreground '"10 2, a color filter 9 that radiates only the selected colors of at least one, preferably two ranges of visible light, which are spaced from each other in the spectrum, is arranged here In front of the image sensor or the lens system therein of camera 1, another 15 color filter 8 is then arranged through which the light emanating from the scenery flows towards the image sensor. it filters or blurs precisely those ranges of the spectrum that are allowed to pass through the color filter 9. As a result, in the image sensor, the background appears faint or black in relation to the foreground 2 that radiates in particular the light of the frequency ranges that they are allowed to pass through the filter *. ¶ - - · ~. '~ of colors 8. The dark zones thus form a mask in the% signal image 4 of the image sensor, a mask that allows to implement the modulation in the dark zones and then in the
25 W background. In this way, the profile analysis device 5 is able to differentiate the bottom 3 from the first plane 2.
In this embodiment, filters 8 and 9 are preferably interference filters complementary to each other, ie permeable to different ranges, preferably not overlapping the visible spectrum. The color filter 9 can be dispensed with if the background 3 radiates only light from the specific frequency ranges that are filtered by the filter 8. Such a self-illuminated background can be produced with, for example, LEDs that radiate a spectrum defined. The color filter 8 is then designed to blur or precisely filter the frequencies radiated by the LEDs.
5 Filter 9 can be selected so that the color zones of the visible spectrum that are allowed to pass through are sufficient to display the colors that occur in the background. Correspondingly, the color filter 8 can also - be selected-so that the frequencies-that are allowed to pass through it, are sufficient to display the colors that occur in the foreground 2. In this way, the image produced by the sensor Image can be used without correction. However, foreground color correction is always possible in the image recorded by the image sensor, which corrects any color deviations due to filter 8.
Figure 5 shows another construction to implement the method according to the invention. For coding, the background radiates non-visible electromagnetic radiation 10 which can be, for example, ultraviolet or infrared radiation. A pIanar 11 conversion device is now disposed in front of the image sensor or in front of the lens 1 of camera 1, a conversion device that allows radiation to pass through it in zones and has elements 15 in zones that are, for example, for example, fluorescent or phosphorescent, through which the non-visible radiation 10 is converted into visible light 13. The elements 15 can thus be arranged uniformly and in particular in a grid on a surface of the device 11 so that the visible light 12 can achieve pass through each zone, on the one hand, and on the other hand, non-visible radiation 10 can be converted into visible light. All the radiation that strikes the image sensor passes through the device 11. In the image sensor, the light that passes unchanged through the device is thus represented and the light 13 produced by the conversion of the non-visible radiation 10.
Since the non-visible radiation 10 emanates from the bottom 3, the image sensor of the camera 1 records the light 13 5 precisely where the bottom 3 is viewed. Preferably, the color of the light 13 produced by the device 11 is selected so that it can be 0 differentiated from the colors that occur in the foreground 2. The light produced "13 then forms a mask through which c)" 10 background 3 can be differentiated from the foreground 2 by a modulation process. Since the elements 15 for the conversion of non-visible radiation into visible light 13 radiate indirect light 13, a lens 14 can be assigned to each of the elements 15, 15 which lens is arranged in such a way that it represents the light not converted 13, from the perspective of the image sensor, at the bottom 3. Preferably, the filtering can also be provided for each element, whose filtering allows light to pass only in the direction of the path of the optical beam.
Figure 6 shows another possible arrangement of the invention for implementing the method according to the invention. The bottom 3 thus radiates polarized light 16 in a specific polarizing W direction. A color filter 17 and also a polarization filter 18 is now arranged in front of the "25 image sensor in chamber 1, whose direction of passage is perpendicular to the polarization direction of the light 16 radiated from the bottom. When using polarization circular, the direction of rotation would be complementary to the polarization rotation, preferably, the light emanating from the scenario 30 flows first through the color filter 17 and after the polarization filter 18 before impacting the image sensor. through the image sensor, the background appears dark, without a color tone, in this arrangement. For direct viewers of the scenery, background 3, in contrast, appears with its normal colors since these observers can perceive the polarized light 16. A color tone, which the foreground 2 has in the image produced 5 by the camera image sensor 1, due to the color filter 17, can subsequently be compensated for in the image signal 4, by the computer. In this form of execution of the method, the components of dark yinning without a color tone, that is, - the components of the image that result from background 3, form a mask, through which modulation of form can be introduced to differentiate background 3 from foreground 2.
Figure 7 shows another arrangement for implementing the method according to the invention. Background 3 thus radiates non-visible radiation 10, for example ultraviolet radiation, or infrared radiation in addition to the current image. In front of the image sensor, preferably in the direction of the beam path behind the image lens system of camera 1, a conversion device 19 is arranged, in this embodiment, through which a visible image of the bottom 3 can be produced from non-visible light. The device 19 thus has a beam separator 20 and a semi-permeable mirror 21 which are arranged in succession along the path of the light beam that falls on the image sensor of the scene. The beam splitter 20 deflects non-visible light, at least partially, in an image sensor 22 of the conversion device 19. A converter 24 records the image produced by the image sensor 22 from the non-visible radiation, l 10 and produces, in an image viewer 23, an image of visible light that corresponds to the image recorded by the image sensor and therefore shows precisely the pattern that is predefined by the non-visible radiation 10. The image produced by the image view is then mixed in the path of the light beam that strikes the image sensor of camera 1 from the scene, through a semi-permeable mirror 21 and serves, in the image signal produced by the sensor in camera 1, as a standard for the production of 5 um coding mask, through which the foreground 2 can be differentiated from the background 3 by modulation.
Figure 8 shows, at the top and bottom, the spectra of two mutually complementary interference filters "in representations". The - · 10 light frequency is plotted on the horizontal axis and is intended to cover essentially the visible range in the illustrated example. The respective intensity that the light, which passed through the corresponding interference filter, is plotted on the vertical axis if the interference filter is radiated with a white light that comprises all the frequencies of the illustrated range with the same intensity. It can be detected that the interference filters let a plurality of ranges of visible light pass through a spacing in the spectrum. The zones of the passing light can thus be chosen on both interference filters in such a way that all the necessary colors of background 3 or foreground 2 can be composed from these. Both interference filters illustrated are I. mutually complementary which means that those areas of the spectrum that are allowed to pass through the '25 interference filter shown at the top are filtered precisely by the bottom interference filter while those Erequences that are filtered by the top interference filter they are allowed to pass precisely through the interference filter at the bottom.
Reference may be made to the fact that the filters do not need to completely filter the components of corresponding colors in order to make the method according to the invention possible. Blurring is also appropriate. Besides that,
it is also not necessary for the frequency ranges to be separated from each other as clearly, as schematically shown in Figure 8. A certain degree of overlap of the ranges allowed to pass through the different filters is permissible.

权利要求:
Claims (29)
[1]
1. METHOD OF DIFFERENTIATING BETWEEN THE FUND AND THE
FIRST PLAN OF A SCENARIO IN IMAGES RECORDED BY AN ELECTRONIC CAMERA, characterized by the background displaying an arbitrary image encoded with a coding so that the image is visible to a direct viewer of the background, and the background is differentiated from the non-foreground encoded in a signal produced by an image sensor, which records images from the camera through encoding.
10
[2]
2. METHOD, according to claim 1, characterized in that the encoding comprises the background displaying the image in the form of a periodic sequence of components that make up the image, at least one image parameter that influences the image display being changed respectively during each period, and an exposure of the camera's image sensor is made synchronously with the visualization of a specific component.
[3]
METHOD, according to claim 2, characterized by a time average of the encoded image over at least one period corresponding to the image.
[4]
4. METHOD according to claim 2 or 3, 'characterized in that a period of duration of a recording cycle of the image sensor is less than or equal to a period duration of the periodic sequence of the visualization of the 25 components.
[5]
5. METHOD, according to any one of claims 1 to 4, characterized in that the coding comprises the background showing different components that alternate periodically from the image, the components of 30 respectively each period that make up the complete image, the visualization of the components being synchronized with an exposure of the camera in such a way that the camera only records one of the components in at least one, preferably
2 / '7.
W m in each period.
[6]
6. METHOD, according to claim 5, characterized in that the component recorded by the chamber is selected in such a way as to allow the differentiation of the first 5 pIan in relation to the background through modulation, preferably through chroma modulation, and in which the background it is differentiated from the foreground in the images recorded by the image sensor through mcAulation, preferably through chroma modulation.
[7]
10 7. METHOD, according to claim 6, characterized in that the component of a period recorded by the image sensor enlarges a color component, which essentially does not occur in the foreground and the other components exhibit this color component of correspondingly reduced shape so that the components together make up the colors of the image.
[8]
METHOD according to any one of claims 2 to 7, characterized in that two components are displayed alternating with a frequency that is twice as high as a frequency of exposure of the chamber.
[9]
9. METHOD, according to any one of claims 1 to 8, characterized in that the cocification of the image comprises the background periodically showing alternating patterns that complement each other within a period to form the complete image and in which the background is differentiated from the foreground in the image sensor signal through a periodically alternating pattern.
[10]
10. METHOD, according to claim 9, characterized in that an image sensor exposure frequency and the pattern display is synchronized with each other and / or a Fourier transform is implemented in the image sensor signal and the background be differentiated from the foreground through the frequency of viewing
3/7 alternating patterns.
[11]
11. METHOD, according to claim 9 or 10, characterized in that the pattern exists in a mathematically distinguishable structure, preferably being periodic in a digitizing direction of the image sensor, the pattern being preferably a chessboard type pattern.
[12]
12. METHOD, according to any of claims 9 to 11, characterized in that each of the patterns of a period is a binary pattern that is completely permeable to light or self-illuminated in zones and less permeable to light or less permeable to light of a color in zones or impermeable to the corresponding light or illuminating in a weaker way, or not illuminating at all, in the corresponding color.
[13]
13. METHOD, according to claim 1, characterized in that the coding comprises the background showing the image only with the colors selected from one, preferably at least two ranges of the visible spectrum in spacing from each other, and the light emanating from the background pass through a color filter, preferably an interference filter, before affecting the image sensor, a color filter that filters or blurs these ranges of the visible spectrum, and let other legs of the visible spectrum pass through without being blurred.
[14]
14. METHOD, according to claim 1 or 13, characterized in that the encoding comprises the image being represented in a grid of colored dots on a backdrop, the colored dots together with the backdrop that 'surrounds them make up the color of the image, and a color filter is arranged in front of the image sensor, a color filter that blurs the colors of the colored dots and preferably lets the colors of the background pass without being blurred, in which the background is different from the first plane through modulation, preferably chroma modulation, in the background color.
[15]
15. METHOD, according to claim 14, 5 characterized in that the colors of the colored dots and the colors of the backdrop form disunited parts of the visible spectrum, preferably the light of the colored dots passes through at least one spectral filter, preferably one filter, - interference, that the light emitted does not pass through the "10 same, and in which the filter arranged in front of the image sensor is a spectral filter, preferably an interference filter, which is complementary to the interference filter or filters in front of the colored dots.
[16]
16. METHOD, according to claim 14 or 15, 15 characterized by the fact that the colored dots are self-illuminating, preferably light diodes.
[17]
17. METHOD, according to claim 1 or 13, characterized in that the coding comprises the background radiating only the colors selected from one, preferably at least two legs of the spectrum visible at a spacing from each other in the spectrum, the light that emanates do 'scenario go through a color filter before focusing on the k image sensor, a color filter that blurs these ranges of the visible spectrum, from which the "25 colors of the image are selected, and let ranges of the visible spectrum pass located between these legs without being blurred, the background is differentiated from the foreground by modulation in the spectrum ranges blurred by the color filter in front of the image sensor.
[18]
18. METHOD, according to claim 17, characterized in that an interference filter is arranged in the scenario behind the foreground and in front of the image, an interference filter that blurs the ranges of the visible spectrum that are not the ranges to be from which the colors of the Eundo are selected and where the color filter through which the light passes before reaching the image sensor is an interference filter that is complementary to the mentioned interference filter.
[19]
19. METHOD, according to claim 1, characterized in that the coding comprises the background radiating, letting through or reflecting electromagnetic radiation ___ from at least one non-visible spectral range and a conversion device in front of the image sensor that converts non-visible electromagnetic radiation into visible light that is detected by the image sensor.
[20]
20. METHOD, according to claim 19, characterized in that the conversion device is planar and converts, at least in part of its surface, the non-visible radiation that is radiated, allowed to pass through or reflected by the bottom into visible light that is detected by the image sensor and the background is differentiated from the foreground by modulation in the converted light.
[21]
21. METHOD, according to claim 20, characterized in that the filter has dots of fluoresceite or phosphorescent material distributed over its surface, preferably arranged in a grid, dots which illuminate at specific wavelengths because they are excited by non-visible radiation , and also a device preferably a lens, assigned to each of the dots in order to visualize the corresponding fluorescent or phosphorescent dots on the image sensor.
[22]
22. METHOD according to claim 1, characterized in that the coding comprises the background radiating or reflecting polarized light only in a specific polarization direction or rotation of polarization,
the light that emanates from the scene goes through a color filter and a polarization filter before focusing on the image sensor, a filter that is oriented in order to filter the light of that polarization that is radiated and reflected by the background and the differentiation of the background in relation to the foreground be carried out by modulating the darkest areas of the image recorded by the image sensor that has no color tone from the color filter, the light emanating from the scene passing preferably through the color filter and subsequently through the polarization filter.
[23]
23. METHOD, according to claim 19, characterized in that the electromagnetic radiation emanating from the scene passes through a conversion device before impacting the image sensor, preferably after passing through a camera lens system, This conversion converts non-visible electromagnetic radiation into visible light and mixes it in the scene from the perspective of the camera at the bottom location.
[24]
24. METHOD according to claim 23, characterized in that the conversion device has a beam separator that deflects a part of the radiation and / or the non-visible electromagnetic radiation in the direction of a converter that mixes an image corresponding to the background in the beam path in front of the image sensor, preferably through a permeable mirror, using radiated electromagnetic radiation.
[25]
25. METHOD according to any one of claims 1 to 24, characterized in that the encoding of the image comprises an oscillation of the image sequence and the oscillation is taken into account in differentiating the foreground from the background.
[26]
26. METHOD, according to any one of claims 1 to 25, characterized in that the first plane is reconstructed in the image signal after differentiating the background and foreground.
5
[27]
27. METHOD, according to any one of claims 1 to 26, characterized in that the image is in the image of an image sensor with the help of
B camera in detection mode and / or camera in detection mode assist in differentiating the background and foreground.
"10
[28]
28. METHOD FOR REPLACING A BACKGROUND FROM A SCENERY IMAGE, characterized in that the background is differentiated from a foreground by means of a method as defined in any of claims 1 to 27 and the background is replaced by a different background.
15
[29]
29. ELECTRONIC VISUALIZATION SYSTEM, characterized by having at least one viewer and also at least one camera, a method as defined in any one of claims 1 to 28 being able to be implemented with the electronic visualization system.
y * u ~ 2/4) ¶ "Background '" Foreground 1, 1' Aa.
; Áj) | ') í' .-
K, m ·. 'Lens m k · "camera' '' 'i.' "" &;} 'q% ·' "": Caixà d; "" '",. '..' "':' · -" i · '',, Ê. Ç .
',. '7: .. ,, Ljg, -; . Y ": j. Q 'Image analysis" progessamentQ de ".it'} '.r":, and' Azores filter Í4b. . ,.
0. ,% '¶ jíj': geá:% '"} FaY",', ',, :: P. r' "'; j' '" "" -. ± - · '".. ... ... · .q,..,. ,,"'. ,: '. · T ·' Y. ' : "'·'" E> 3 'r' · "'. A-,:' k · - q" "0,. · K.... P '" Ç. & P , ¶ P . (. © ·. .. ^ "tjs, '"' h. T - Z '.. _.. .... -':. · W '; ·· G e' ', "^ #,' ' ·. "S" Ae J, "" ''% "':; .Y .á *.' 4, <2 èç,: = 4 '". ".":' OF - - rm P- · - " . P .. .. '· s & W7F¶'.,.: Mm "Y / iF:"; "'magnet :(' &'j'; t. M: ,,, ,, 'T>' tbWí": 'Si- i; "àí5. :: €', - '" = ·· "#!' ;: .r: 'Fb .'- Ig" · gi ,, ^ ".- $ m; íT.ãçYàÍ . 'i · (4 "¥' - '·." · "' C * '', - ±: $ V. · - '' Nt't,. ~ m <· '=' 'C¶ ·: .A ... P Ü "'' rp" "S, 0 t. ',.' Pa: i: · '· .µg", "% 0 0 0 ·. Y. B'i F" 4Yk " ; E ': qs $: ·'; t '· Ffí ¥ S: N.fµÃ' is ·. · '-' ::. "Y> - + './.+G.:· :.'. Yi ) ".:" .- '. m "·' · '. · 4 ·' q â". "L '·;"'!: 'j:.: ¢ ·' À · - ç b '; 0. * m.: · Fund N "· * $ - Z ',' ! first year! P F '; 3 ¥ · .-' j ·· ·" '3. ¥ G-'. '"·' --- '". ·· - 4 ·' · K- ±: 'n; ZúàSkw =: m4: ·· - j"' m : "';;' - '· ·" - "': ° ) "" "'" "'" '":"' ^ "'Á'," "" 'Z =, N "" "^" "3," .Z' A:.,. -. 0} " > "hf t. gr · '";.. "" b 6 # í "mi' 'K Re.' & ''" "'Box of:' .AiiáB $ êde fmágem '"' (9 í. 1à ^ -nr »~, = M7n = ¶ma '' n" .., ^, _, _ ç · k, e "
S 'a' 'e =% b' à ': r- íe, n, te "camara" -: ,,,'. p ~ samenmk '!' t + '".., à ' '- ·' r ã®.". : MRú í ": Mgem '% &: m ¥ mm, $.,' ' 7: t h, A $ ·" ",: M" ..,' m 4 "-., Y - '.' '"M .t F,,: C"' i <'4iitro ,, 5 · 3' ± · color · L "n = A · 'gr" E., · T Color filter B p "A" b ,. = "" '' —.- "'"' '"laughs. - -.
Zn Cr
- 3/4 | '""; JÂ jjj "'" ° m "" ,, a Aa 1 ,. {AbT / "'s':' j ~» '') z u'j "; u '"' "'<" - j' "; '" "', y L i, | / "'" "" "" "" ""':; G-. · -..-. ,, F ,, t Box of t 'r i. " '' "'" "'" '' '' 7 G "GWZf '·'; Yt q'l4 (. 'G · -'; 'Image a'állse'.: - '' j! Á) i "= iLÀ; ::: í '"!' t '/' t ")" "'" i: "'" ^} '""', "t - '::::'" 'í í' 4322: sj = "'j'" "i: X. &,: <JM '" ¢ "" f "U"' N yj "" fO,. '"' 't ·' f,, ,,, ..., ..., .., -,. | ..,
W a2j 'lZ -. ·' '., -.! .-. '' -: · '· .-. . · '' "'I ·. · N ;; ·.'" '"^"' A "" "" "#" "''" "" '",:" 4,, ...'. ., "!:. :: '" ¥: Ab'3' 4, ij '' y " : '·: .. i'd';: Í: í:; i '"' "'" " "" '- "' ':'". '-'- ";' - '' ··" -. "" "" "" · J: h, .. ".:, ': ,,: ,,, ... i., -" " · M 0 "'i:' e & rmmtd $ µ" "!" '' "F," b '4 z-7 "' · 2 ':" "'" '""' "'b' ¶ · 'PU. · R. Auto-ing material, l "i 'J"' q '. +. . Lens of ,,, ': ·' "'-" ", -'. '. Magnet ··" j:'. , "": ": '' z: '; 3' % ,, - ',,; - - r:".:' 7,.
l. ..;; 'u:' "} - '.'. ·· '!:':" illuminated · ·, <"" F '. "'; '. Á" .'hÇ "* 5 .4' ; ¢ 7.'Í 'b group i!:' :! ": Â,, h kr.," ,, ':, ::.'! T.:.3.,'3 '[t-:> T ',: - ;,' · "'Z. 0,,,. '..; t- "·':" "'="': "" '"'". y ,, · 3 '' '' = j, s' '-' "" -.- ·:. & · 2í>} ,,,,,, -. ,. <à '+' ".
V.
. W '© L'. '"r S .-.,. Y .n" 0 0' d P 0 'P.' · mS: · '%:% aMT ¢ H'm J "" P' "'" magnet' '& . , qç '«': '" $: · "4Y. · '". ·' .2í: ': mr' 'i.b' n,.,. 'Í'. '.' '.Lt.,': ..«;, '""! V ;;' '; SÜkY i, 7 "' 'Y" "0' S,: '' u ': · E. .
, .f% ::, · —t'-; ',. "· Laughs" j. P . . -,.; ç - h "'Fu" do a "" - "À6.' 'Primeim plamò "AZ'. "; .. = A $ t A / '.
g 'j' T "j;" "" "" "" '' "a" n 'e », ... A'b ^ 6, É | l |'" _ | ià) '' E)) !! i, e. ::. (i, 3j: ': | · "í)' ,, '3:' = '7: ¶'gi *' Polarized '-" 4' 0 Color filter.. -...—. 'Polarization filter â E3. G
W ^ [d. = + "u- -" '4/4 ---.-.- AO - "P, imei, plam, t9 1 / A b / S Background À a-' ¥ àq" LAk "3i",% ltb .;, ¶I.,. Lx. ' èai:; ': T ,. ..j ",, :: ' £. ,,, o2 j) jjj: i") JS · ÊÉ # 6k, ¢' ('u)! :: í "" "" "i; C:.: -'4: íi S = "_
L ^, j2 ;; ÊlÊÊ7i! . ": '4': Z , ¢: i '::" 7.í, .'. . 4 '· - ·: q- Ü' '"i:. 2, N'", ' ':,:,:. 23, -: '· "" -% Y't'K ",, xt ¶ ',, .z:.' . '".- ". ·· "· -.
= °) · 7j S, n, o, from imageâ qji4it '"Yi! R' : 'Kz!' Tqí! T '.. ::,!,':" Í: |: ':' :; ,,, m ,,, m F! Eçj ',. is,' F , n: $ L'p tg'dlè '!: j ' .,. .,.
". .. ::;" :: m'- '"" FYiy-m'Si'b ¥ 7' .'- .. -. · · "'"% Ú, · <5> «",,.' , '¶', '.,. ·. · .::' '' '' "" "L ''" "'à:, ií'" '"ü" i' intensity r '
U (W b 0;. ') 0
N ''! "" "Frequency>. T
W I 0 W 't b 0
V 0 Q lntensidadç. % y b
P .
»K
F r M r '"
W r N ¶ «P 0
I Q
P r b a
W ¶ 0 q b +
V b 0 Frequency "FÇ, K 8

类似技术:

---

公开号 | 公开日 | 专利标题

---

BR112013006763A2|2020-10-06|method to differentiate between the background and foreground of a scenario in images recorded by an electronic camera, method to replace a background of an image of a scenario and electronic visualization system

---

US8483557B1|2013-07-09|Camera flash filter

---

US20080198256A1|2008-08-21|Electronic motion picture camera

---

EP2476296B1|2015-11-11|Illumination system for enhancing the appearance of an object and method thereof

---

JP6633884B2|2020-01-22|3D image display device

---

EP3025131A1|2016-06-01|Lighting device for adjusting a light colour separately within several zones

---

CN108848370A|2018-11-20|Full parallax changeable bore hole 3D display device and its display methods

---

JP2016097240A|2016-05-30|Imaging device and imaging method

---

RU2293375C2|2007-02-10|Method for producing demonstration image with color alteration

---

JP6660166B2|2020-03-11|3D image display device

---

WO2013017590A1|2013-02-07|A printing method for performing cryptography, and equipment designed according to said method

同族专利:

---

公开号 | 公开日

---

PE20180320A1|2018-02-12|

---

US20190215466A1|2019-07-11|

---

AU2011304767A1|2013-04-04|

---

MY164379A|2017-12-15|

---

CO6680715A2|2013-05-31|

---

JP2016154338A|2016-08-25|

---

EP2619975B1|2018-03-28|

---

RU2572207C2|2015-12-27|

---

CL2013000751A1|2013-09-13|

---

US20130243248A1|2013-09-19|

---

AR106832A2|2018-02-21|

---

RU2013114194A|2014-10-27|

---

MX337499B|2016-03-09|

---

NZ609152A|2015-05-29|

---

AU2016202378A1|2016-05-05|

---

AU2011304767B2|2016-01-14|

---

ES2673306T3|2018-06-21|

---

MX337498B|2016-03-09|

---

PT2619975T|2018-06-07|

---

NZ705446A|2016-10-28|

---

KR20130096735A|2013-08-30|

---

NZ724280A|2018-03-23|

---

US20160255283A1|2016-09-01|

---

MX2013002984A|2013-08-01|

---

US10313607B2|2019-06-04|

---

US11165973B2|2021-11-02|

---

ECSP13012500A|2013-05-31|

---

PH12017500065B1|2018-03-05|

---

PH12017500065A1|2018-03-05|

---

EP2619975A1|2013-07-31|

---

CA2811222C|2019-08-27|

---

JP2013537384A|2013-09-30|

---

EP3340610A3|2018-09-26|

---

KR101826178B1|2018-03-22|

---

PL2619975T3|2019-03-29|

---

MA34597B1|2013-10-02|

---

ZA201301772B|2014-03-26|

---

AU2016202378B2|2018-05-24|

---

PE20140057A1|2014-03-01|

---

JP5944904B2|2016-07-05|

---

KR102002331B1|2019-07-23|

---

US9355325B2|2016-05-31|

---

EP3340610A2|2018-06-27|

---

KR20180015757A|2018-02-13|

---

AR083054A1|2013-01-30|

---

CA2811222A1|2012-03-29|

---

NZ705445A|2016-02-26|

---

IL225194D0|2013-06-27|

---

SG10201507715WA|2015-10-29|

---

CN103155539A|2013-06-12|

---

SG188569A1|2013-04-30|

---

SG10201507710TA|2015-10-29|

---

US20220046187A1|2022-02-10|

---

WO2012038009A1|2012-03-29|

---

JP6431861B2|2018-11-28|

---

AR106831A2|2018-02-21|

---

CN103155539B|2016-06-22|

---

CA3024819A1|2012-03-29|

---

TR201807589T4|2018-06-21|

---

IL225194A|2017-06-29|

---

UA115303C2|2017-10-25|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

---

US3723005A|1965-12-13|1973-03-27|Gen Electric|Wide angle sighting apparatus|

---

JPS539692B2|1972-06-19|1978-04-07|

---

JPH0483480A|1990-07-26|1992-03-17|Nippon Hoso Kyokai <Nhk>|Polarizing key type image synthesizer|

---

IL108957A|1994-03-14|1998-09-24|Scidel Technologies Ltd|System for implanting an image into a video stream|

---

CA2187614C|1995-10-10|2002-11-26|Jonathan Erland|Traveling mat backing|

---

FR2749116B1|1996-05-24|1998-06-19|Thomson Multimedia Sa|SPECIAL EFFECTS CAMERA|

---

US6310733B1|1996-08-16|2001-10-30|Eugene Dolgoff|Optical elements and methods for their manufacture|

---

US5986718A|1996-09-19|1999-11-16|Video Magic, Inc.|Photographic method using chroma-key and a photobooth employing the same|

---

US6532022B1|1997-10-15|2003-03-11|Electric Planet, Inc.|Method and apparatus for model-based compositing|

---

JPH11353703A|1998-04-06|1999-12-24|Seitai Hikari Joho Kenkyusho:Kk|Information recording medium and information reading system|

---

JP3241327B2|1998-08-22|2001-12-25|大聖電機有限会社|Chroma key system|

---

JP4121639B2|1998-11-12|2008-07-23|三洋電機株式会社|Object image clipping method, apparatus, system, and medium on which program is recorded|

---

US6342887B1|1998-11-18|2002-01-29|Earl Robert Munroe|Method and apparatus for reproducing lighting effects in computer animated objects|

---

WO2001006766A1|1999-07-15|2001-01-25|Scannova Gmbh|Method for image data processing and camera recording system|

---

GB2358098A|2000-01-06|2001-07-11|Sharp Kk|Method of segmenting a pixelled image|

---

US20020168091A1|2001-05-11|2002-11-14|Miroslav Trajkovic|Motion detection via image alignment|

---

EP1449357A4|2001-06-19|2006-10-04|Ecole Polytech|Method and system for combining video with spatio-temporal alignment|

---

JP2003046854A|2001-08-01|2003-02-14|Olympus Optical Co Ltd|Imaging apparatus|

---

KR100443678B1|2001-09-29|2004-08-09|엘지전자 주식회사|Object domain detecting method for image|

---

JP4033006B2|2003-03-12|2008-01-16|日本電信電話株式会社|Image processing apparatus and method, and program|

---

EP1499117B1|2003-07-16|2007-12-05|British Broadcasting Corporation|Video processing|

---

FR2868185B1|2004-03-23|2006-06-30|Realeyes3D Sa|METHOD FOR EXTRACTING RAW DATA FROM IMAGE RESULTING FROM SHOOTING|

---

IES20060558A2|2006-02-14|2006-11-01|Fotonation Vision Ltd|Image blurring|

---

ITRM20060136A1|2006-03-10|2007-09-11|Link Formazione S R L|INTERACTIVE MULTIMEDIA SYSTEM|

---

US7609327B2|2006-04-19|2009-10-27|Mitsubishi Electric Research Laboratories, Inc.|Polarization difference matting using a screen configured to reflect polarized light|

---

US7344305B2|2006-08-01|2008-03-18|Siemens Medical Solutions Usa, Inc.|Remote visual feedback of collimated area and snapshot of exposed patient area|

---

JP2008092120A|2006-09-29|2008-04-17|Fujifilm Corp|Image compositing system|

---

US8045060B2|2006-10-04|2011-10-25|Hewlett-Packard Development Company, L.P.|Asynchronous camera/projector system for video segmentation|

---

DE102007041719B4|2006-11-06|2010-01-28|Bauhaus-Universität Weimar|Method for creating augmented reality in a room|

---

US20080168512A1|2007-01-04|2008-07-10|Nguyen Thuyen X|System and Method to Implement Interactive Video Streaming|

---

DE102007004719B4|2007-01-31|2018-04-05|Mhz Hachtel Gmbh & Co. Kg|Method for mounting a winding arrangement of a blind|

---

JP2008241447A|2007-03-27|2008-10-09|Fujifilm Corp|Apparatus and method for reading image|

---

US7934862B2|2007-09-24|2011-05-03|Munisamy Anandan|UV based color pixel backlight for liquid crystal display|

---

JP5038101B2|2007-11-12|2012-10-03|キヤノン株式会社|Radiation imaging apparatus, driving method thereof, and program|

---

JP2010014639A|2008-07-07|2010-01-21|Hitachi Maxell Ltd|Imagery capturing device, conversion device, and thermal imagery capturing technique|

---

WO2010036772A2|2008-09-26|2010-04-01|Dolby Laboratories Licensing Corporation|Complexity allocation for video and image coding applications|

---

FR2947939B1|2009-07-08|2011-08-19|Electricite De France|WHEELCHAIR TRAILER SIMULATOR.|

---

EP2556463A2|2010-04-07|2013-02-13|Sproxil Inc.|System and methods for verifying authenticity of a product|

---

NZ705446A|2010-09-20|2016-10-28|Fraunhofer Ges Zur Förderung Der Angewandten Forschung E V|Method for differentiating between background and foreground of scenery and also method for replacing a background in images of a scenery|

---

EP3398963B1|2017-05-04|2021-09-29|Eberhard Karls Universität Tübingen Medizinische Fakultät|Chemically modified mrna for use in the treatment of a disease associated with the cftr gene|NZ705446A|2010-09-20|2016-10-28|Fraunhofer Ges Zur Förderung Der Angewandten Forschung E V|Method for differentiating between background and foreground of scenery and also method for replacing a background in images of a scenery|

---

EP3324376A1|2012-10-29|2018-05-23|NetEnt Product Services Ltd.|Architecture for multi-player, multi-game, multi- table, multi-operator & multi-jurisdiction live casino gaming|

---

CN103929585B|2013-01-15|2018-02-27|联想有限公司|A kind of control method of polaroid, electronic equipment and system|

---

US20150289338A1|2014-04-08|2015-10-08|Revolution Display, Inc.|Automatic chroma key background generator with incident key lighting|

---

WO2015175818A1|2014-05-16|2015-11-19|Musco Corporation|Sports lighting to increase contrast|

---

US9838661B2|2014-05-30|2017-12-05|Lifetouch Inc.|Photographic scene replacement system|

---

CN104361577B|2014-10-20|2015-08-19|湖南戍融智能科技有限公司|A kind of foreground detection method based on depth image and visual image fusion|

---

CN104361580B|2014-10-22|2015-06-24|山东大学|Projected image real-time correction method based on planar screen|

---

US10321100B2|2014-12-02|2019-06-11|Ademco Inc.|System and method of foreground extraction for digital cameras|

---

EP3104330B1|2015-06-09|2019-02-20|Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.|Methods for tracking at least one object and method for replacing at least one object with a virtual object in a motion picture signal recorded by a camera|

---

CN105611426B|2016-01-15|2019-04-05|深圳市奥拓电子股份有限公司|A kind of virtual display image method and device|

---

JP6833348B2|2016-05-25|2021-02-24|キヤノン株式会社|Information processing device, image processing system, information processing device control method, virtual viewpoint image generation method, and program|

---

CN106199971A|2016-08-30|2016-12-07|上海丹诺西诚智能科技有限公司|Display color of image adaptive approach and device for HUD|

---

DE102016119639A1|2016-10-14|2018-04-19|Uniqfeed Ag|System for dynamic contrast maximization between foreground and background in images or / and image sequences|

---

US10750136B2|2016-10-17|2020-08-18|Sony Corporation|Image processing apparatus, image processing method, and image pickup device|

---

ES2755776T3|2017-02-02|2020-04-23|Fraunhofer Ges Forschung|Procedure to replace image content|

---

KR20180098065A|2017-02-24|2018-09-03|삼성전자주식회사|Display apparatus and control method thereof|

---

US10270986B2|2017-09-22|2019-04-23|Feedback, LLC|Near-infrared video compositing|

---

US10674096B2|2017-09-22|2020-06-02|Feedback, LLC|Near-infrared video compositing|

---

US10560645B2|2017-09-22|2020-02-11|Feedback, LLC|Immersive video environment using near-infrared video compositing|

---

RU2744699C1|2017-12-14|2021-03-15|Кэнон Кабусики Кайся|Generating apparatus, method of generation and program for a three-dimensional model|

---

CN108289220B|2018-01-15|2020-11-27|深圳市奥拓电子股份有限公司|Virtual image processing method, image processing system, and storage medium|

---

CN108765278A|2018-06-05|2018-11-06|Oppo广东移动通信有限公司|A kind of image processing method, mobile terminal and computer readable storage medium|

---

EP3831049A1|2018-07-27|2021-06-09|Appario Global SolutionsAG|Method and system for dynamic image content replacement in a video stream|

---

JP2021001933A|2019-06-20|2021-01-07|日東電工株式会社|Set of optical films for image creation system|

---

JP2021001934A|2019-06-20|2021-01-07|日東電工株式会社|Set of optical films for image creation system|

---

CN110896498A|2019-10-03|2020-03-20|刘纪君|Computer airport scene special effect system|

---

DE102019220278A1|2019-12-19|2021-06-24|Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V.|Procedure for viewing videos|

---

CN111225198A|2020-03-11|2020-06-02|潍坊学院|Liquid crystal polarization invisible word-drawing DLP projector system and video data processing method|

---

CN111246192A|2020-03-16|2020-06-05|潍坊学院|Invisible prompter projector system and video data processing method|

法律状态:
2020-10-20| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|

---

2020-10-20| B15K| Others concerning applications: alteration of classification|Free format text: AS CLASSIFICACOES ANTERIORES ERAM: H04N 5/272 , H04N 9/75 Ipc: H04N 5/222 (2006.01), H04N 5/272 (2006.01), H04N 5 |

---

2021-11-23| B350| Update of information on the portal [chapter 15.35 patent gazette]|

优先权:

---

申请号 | 申请日 | 专利标题

---

DE102010046025.7|2010-09-20|

---

DE102010046025|2010-09-20|

---

PCT/EP2011/004114|WO2012038009A1|2010-09-20|2011-08-16|Method for differentiating background and foreground of a setting and method for replacing a background in images of a setting|

---